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Summary 

\ 

"si 

The  purpose  of  this  paper  Is  to  show  how  the  functional 
equation  technique  of  the  theory  of  dynamic  progranunlng  yields 
a  very  simple  computational  algorithm  for  the  solution  of 
mathematical  models  arising  In  stock  level  studies. 

A  numerical  solution  of  these  problems  relying  upon  linear 
programming  techniques  had  previously  been  given  by  Charnes 
and  Cooper.  ^ 
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NOTES  ON  THE  THEORY  OP  DYNAMIC  PROORAMMINO — ^VI 
THE  WAREHOUSING  MODEL 

By 

Richard  Bellman 


§1 .  Introduction 

In  a  recent  report,  \2~\  ,  Charneo  and  Cooper  present  a 
solution  by  means  of  linear  programming  techniques  of  one 
version  of  what  Is  called  the  "warehouse  problem"  .  As  formulated 
by  A.  Cahn,  [l j  ,  It  reads 

"Given  a  warehouse  with  fixed  capacity  and  an 
Initial  stock  of  a  certain  product,  which  Is  subject 
to  known  seasonal  price  and  cost  variations,  what 
Is  the  optimal  pattern  of  purchasing  (or  production), 
storage  and  salesT* 

The  purpose  of  this  note  Is  to  Indicate  how  problems  of  this 
general  nature  may  be  approached  by  means  of  the  functional 
equation  technique  of  the  theory  of  dynamic  programming,  and 
thereby  reduced  to  a  very  simple  and  straightforward  compu¬ 
tational  problem. 

In  order  to  compare  the  two  approaches  more  readily, 
we  shall  use  the  formulation  and  notatlori  of  Charnes  and  Cooper, 
[2]. 


§2.  Analytic  Formulation 


Following  the  report  of  Charnes  and  Cooper,  let 
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(1)  fi  -  tho  fixed  Marthouse  capacity 

A  -  the  Initial  stock  in  the  warehouse 
Consider  a  seasonal  product  to  be  bought  (or  produced) 
and  sold  for  each  of  1  -  1,  2,  ...»  n  periods.  For  the  1^*^  period, 
let 

(2)  c^  -  cost  per  unit 

“  selling  price  per  unit 
-  amount  bought  (or  produced) 

»  amount  sold 

The  constraints  are  as  follows: 

(3)  (a)  Buying  constraints:  The  stock  on  hand  at  the 

end  of  the  1^^  period  cannot  exceed  the  ware¬ 
house  capacity 

t  ll 

(b)  Selling  constraints:  The  amount  sold  in  the  i 

period  cannot  exceed  the  amount  available  a'; 
the  end  of  the  (l  -  l)*^  period  * 

(c)  Non— negativity  constraints:  Amounts  purchased 
or  sold  in  any  period  are  non-negative 

Analytically 

1 

(4)  Buying  constraint;  A  +  L  —  yJ  <  1  ■  1»  2,  n, 

J-1  ^  ^ 

(1-1) 

Selling  constraint;  y.  <  A  >  Z  (x ,  -  y  , ) ,  1  -  1 ,  2,  -  ' ,  n, 

J-1  ^ 

for  i  -  1,  this  is  yi  ^  A 
Non-negativity:  x^:  y^^  >  0. 
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The  problem  Is  to  determine  the  quantities  and 
eo  ae  to  maximize  the  ovex'-all  profit 

^ 

§3*  Dynamic  Programming  Treatment 

It  l8  clear  that  the  maximum  profit  will  be  a  function 
of  the  original  quantity  of  stock,  A,  and  the  duration  of  the 
process  n.  Define 

(1)  f^(*;  -  lux  p. 

Where  the  maximum  Is  taken  over  all  admissible  values  of  the 
and  .  We  have 

(2)  fi(A)  -  Max  (piyi  -  CiXi), 

over  all  xi,  yi  satisfying 

(3)  (»)  yi  <  A 

(b)  A  +  (xi  -  yi)  £  B, 

or 

(^)  fi(A)  -  piA. 

We  now  wish  to  derive  a  recurrence  relation  connecting 
f^(A)  and  yi  are  chosen,  the  constraints 

on  the  remaining  variables  are 
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(a) 

(b) 


1 

£  (x,  -  y  J  <  B  -  (A  ^  (xi  -  y  i)  )  , 

J=z 

1-1 

y.  <  (A  (xi  -  yi))  +  Z  (x-  -  y .  ) . 

J-2  ^ 


Hence,  for  n  >  2, 


(6)  LPiyi  -  cixi  f^i(A  +  xi  -  yi)], 

X  I  ,y  I 

where  the  maximum  la  taken  over  the  re^jlcn 


(7)  (a )  y  I  <  A 

(b)  Xi-yi<B-A,  Xi,  yi>0. 

The  variable  A  asaumes  all  valuea  In  the  Interval  L0>  Bj . 


§4 .  Dlscusalon 

Let  ua  now  dlacuea  the  actual  computation  of  the  eolation. 
Ae  far  as  the  memory  and  tabulation  problems  are  concerned, 
we  are  dealing  with  a  sequence  of  functions  of  one  variable. 
Consequently,  no  difficulties  arise  from  this  direction. 

The  maximization,  however,  la  over  a  two  dimensional 
region,  and  a  variable  region  at  that.  Hence,  we  might 
expect  that  the  computation  would  be  slowed  down  by  this  fact. 
Fortunately,  we  are  rescued  by  the  linearity  of  the  process. 
Consider  the  region  defined  by  the  equations  In  (3-7) 
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We  suspect  that  the  maxlrnura  will  occur  at  one  of  the 
vertices,  and  this  may  be  established  rigorously  In  several 
ways,  cither  directly  from  linear  programming,  or  In  an 
Inductive  fashion.  In  the  figure  above,  we  have  assumed  that 
A  >  B  —  A  or  2A  >  B.  In  this  case,  the  vertices  are 

(1)  P,(0,  0),  Ps(0,  B-A),  P,(A,  0),  P4(A,  B). 


If  A  <  B  -  A,  there  arc  only  three  vertices 


(2)  Pi(0,  0),  Pa(0,  B  -  A),  P^(B  -  A,  0). 

Taking  all  five  vertices  as  possible  maximizing  points, 
which  takes  care  of  the  two  cases  B  —  A  ^  A  at  one  time,  we 
can  reduce  (5*6)  to 


(3) 


f  (A) 
n '  ' 


-  Max 


1.  Vi(A), 

2.  -c^(B  -  A)  ^ 

5.  p  lA 

4.  p^A  -  c^B 

5.  P^(B  -  A)  -  -  B) 


or  A  >  0,  with  ff,(A)  »  0  for  A  <  0 


This  computation  Is  now  a  very  simple  one.  The  quantity 
B  Is  taken  as  fixed,  and  A  assumes  all  values  In  the  Interval 
[o,  BJ  . 
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